Benchmarking the generalizability of brain age models: Challenges posed by scanner variance and prediction bias

Machine learning has been increasingly applied to neuroimaging data to predict age, deriving a personalized biomarker with potential clinical applications. The scientific and clinical value of these models depends on their applicability to independently acquired scans from diverse sources. Accordingly, we evaluated the generalizability of two brain age models that were trained across the lifespan by applying them to three distinct early-life samples with participants aged 8-22 years. These models were chosen based on the size and diversity of their training data, but they also differed greatly in their processing methods and predictive algorithms. Specifically, one brain age model was built by applying gradient tree boosting (GTB) to extracted features of cortical thickness, surface area, and brain volume. The other model applied a 2D convolutional neural network (DBN) to minimally preprocessed slices of T1-weighted scans. Additional model variants were created to understand how generalizability changed when each model was trained with data that became more similar to the test samples in terms of age and acquisition protocols. Our results illustrated numerous trade-offs. The GTB predictions were relatively more accurate overall and yielded more reliable predictions when applied to lower quality scans. In contrast, the DBN displayed the most utility in detecting associations between brain age gaps and cognitive functioning. Broadly speaking, the largest limitations affecting generalizability were acquisition protocol differences and biased brain age estimates. If such confounds could eventually be removed without post-hoc corrections, brain age predictions may have greater utility as personalized biomarkers of healthy aging

Prediction of brain age and cognitive age: Quantifying brain and cognitive maintenance in aging

The concept of brain maintenance refers to the preservation of brain integrity in older age, while cognitive reserve refers to the capacity to maintain cognition in the presence of neurodegeneration or aging‐related brain changes. While both mechanisms are thought to contribute to individual differences in cognitive function among older adults, there is currently no “gold standard” for measuring these constructs. Using machine‐learning methods, we estimated brain and cognitive age based on deviations from normative aging patterns in the Whitehall II MRI substudy cohort (N = 537, age range = 60.34–82.76), and tested the degree of correspondence between these constructs, as well as their associations with premorbid IQ, education, and lifestyle trajectories. In line with established literature highlighting IQ as a proxy for cognitive reserve, higher premorbid IQ was linked to lower cognitive age independent of brain age. No strong evidence was found for associations between brain or cognitive age and lifestyle trajectories from midlife to late life based on latent class growth analyses. However, post hoc analyses revealed a relationship between cumulative lifestyle measures and brain age independent of cognitive age. In conclusion, we present a novel approach to characterizing brain and cognitive maintenance in aging, which may be useful for future studies seeking to identify factors that contribute to brain preservation and cognitive reserve mechanisms in older age

The influence of semantic and phonological factors on syntactic decisions: An event-related brain potential study

During language production and comprehension, information about a word's syntactic properties is sometimes needed. While the decision about the grammatical gender of a word requires access to syntactic knowledge, it has also been hypothesized that semantic (i.e., biological gender) or phonological information (i.e., sound regularities) may influence this decision. Event-related potentials (ERPs) were measured while native speakers of German processed written words that were or were not semantically and/or phonologically marked for gender. Behavioral and ERP results showed that participants were faster in making a gender decision when words were semantically and/or phonologically gender marked than when this was not the case, although the phonological effects were less clear. In conclusion, our data provide evidence that even though participants performed a grammatical gender decision, this task can be influenced by semantic and phonological factors

Multi-site genetic analysis of diffusion images and voxelwise heritability analysis : a pilot project of the ENIGMA–DTI working group

The ENIGMA (Enhancing NeuroImaging Genetics through Meta-Analysis) Consortium was set up to analyze brain measures and genotypes from multiple sites across the world to improve the power to detect genetic variants that influence the brain. Diffusion tensor imaging (DTI) yields quantitative measures sensitive to brain development and degeneration, and some common genetic variants may be associated with white matter integrity or connectivity. DTI measures, such as the fractional anisotropy (FA) of water diffusion, may be useful for identifying genetic variants that influence brain microstructure. However, genome-wide association studies (GWAS) require large populations to obtain sufficient power to detect and replicate significant effects, motivating a multi-site consortium effort. As part of an ENIGMA–DTI working group, we analyzed high-resolution FA images from multiple imaging sites across North America, Australia, and Europe, to address the challenge of harmonizing imaging data collected at multiple sites. Four hundred images of healthy adults aged 18–85 from four sites were used to create a template and corresponding skeletonized FA image as a common reference space. Using twin and pedigree samples of different ethnicities, we used our common template to evaluate the heritability of tract-derived FA measures. We show that our template is reliable for integrating multiple datasets by combining results through meta-analysis and unifying the data through exploratory mega-analyses. Our results may help prioritize regions of the FA map that are consistently influenced by additive genetic factors for future genetic discovery studies. Protocols and templates are publicly available at (http://enigma.loni.ucla.edu/ongoing/dti-working-group/)

The ENIGMA Stroke Recovery Working Group: Big data neuroimaging to study brain–behavior relationships after stroke

The goal of the Enhancing Neuroimaging Genetics through Meta‐Analysis (ENIGMA) Stroke Recovery working group is to understand brain and behavior relationships using well‐powered meta‐ and mega‐analytic approaches. ENIGMA Stroke Recovery has data from over 2,100 stroke patients collected across 39 research studies and 10 countries around the world, comprising the largest multisite retrospective stroke data collaboration to date. This article outlines the efforts taken by the ENIGMA Stroke Recovery working group to develop neuroinformatics protocols and methods to manage multisite stroke brain magnetic resonance imaging, behavioral and demographics data. Specifically, the processes for scalable data intake and preprocessing, multisite data harmonization, and large‐scale stroke lesion analysis are described, and challenges unique to this type of big data collaboration in stroke research are discussed. Finally, future directions and limitations, as well as recommendations for improved data harmonization through prospective data collection and data management, are provided

Conservation of Distinct Genetically-Mediated Human Cortical Pattern

The many subcomponents of the human cortex are known to follow an anatomical pattern and functional relationship that appears to be highly conserved between individuals. This suggests that this pattern and the relationship among cortical regions are important for cortical function and likely shaped by genetic factors, although the degree to which genetic factors contribute to this pattern is unknown. We assessed the genetic relationships among 12 cortical surface areas using brain images and genotype information on 2,364 unrelated individuals, brain images on 466 twin pairs, and transcriptome data on 6 postmortem brains in order to determine whether a consistent and biologically meaningful pattern could be identified from these very different data sets. We find that the patterns revealed by each data set are highly consistent (p<10−3), and are biologically meaningful on several fronts. For example, close genetic relationships are seen in cortical regions within the same lobes and, the frontal lobe, a region showing great evolutionary expansion and functional complexity, has the most distant genetic relationship with other lobes. The frontal lobe also exhibits the most distinct expression pattern relative to the other regions, implicating a number of genes with known functions mediating immune and related processes. Our analyses reflect one of the first attempts to provide an assessment of the biological consistency of a genetic phenomenon involving the brain that leverages very different types of data, and therefore is not just statistical replication which purposefully use very similar data sets.publishedVersio

Detection of Epileptogenic Cortical Malformations with Surface-Based MRI Morphometry

Magnetic resonance imaging has revolutionized the detection of structural abnormalities in patients with epilepsy. However, many focal abnormalities remain undetected in routine visual inspection. Here we use an automated, surface-based method for quantifying morphometric features related to epileptogenic cortical malformations to detect abnormal cortical thickness and blurred gray-white matter boundaries. Using MRI morphometry at 3T with surface-based spherical averaging techniques that precisely align anatomical structures between individual brains, we compared single patients with known lesions to a large normal control group to detect clusters of abnormal cortical thickness, gray-white matter contrast, local gyrification, sulcal depth, jacobian distance and curvature. To assess the effects of threshold and smoothing on detection sensitivity and specificity, we systematically varied these parameters with different thresholds and smoothing levels. To test the effectiveness of the technique to detect lesions of epileptogenic character, we compared the detected structural abnormalities to expert-tracings, intracranial EEG, pathology and surgical outcome in a homogeneous patient sample. With optimal parameters and by combining thickness and GWC, the surface-based detection method identified 92% of cortical lesions (sensitivity) with few false positives (96% specificity), successfully discriminating patients from controls 94% of the time. The detected structural abnormalities were related to the seizure onset zones, abnormal histology and positive outcome in all surgical patients. However, the method failed to adequately describe lesion extent in most cases. Automated surface-based MRI morphometry, if used with optimized parameters, may be a valuable additional clinical tool to improve the detection of subtle or previously occult malformations and therefore could improve identification of patients with intractable focal epilepsy who may benefit from surgery

Incident acute coronary syndromes in chronic dialysis patients in the United States11The opinions are solely those of the authors and do not represent an endorsement by the Department of Defense or the National Institutes of Health. This is a U.S. Government work. There are no restrictions on its use.

Incident acute coronary syndromes in chronic dialysis patients in the United States.BackgroundPatients on dialysis have a disproportionately high rate of cardiovascular disease (CVD). However, the incidence and risk factors for incident acute coronary syndromes (ACS) have not been previously assessed in dialysis patients.MethodsWe analyzed the United States Renal Data System (USRDS) Dialysis Morbidity and Mortality Study (DMMS) Wave II in a historical cohort study of ACS. Data from 3374 patients who started dialysis in 1996 with valid follow-up times were available for analysis, censored at the time of renal transplantation and followed until March 2000. Cox regression analysis was used to model factors associated with time to first hospitalization for ACS (ICD9 code 410.x or 411.x) adjusted for comorbidities, demographic factors, baseline laboratory values, blood pressures and cholesterol levels, type of vascular access, dialysis adequacy, and cardioprotective medications (angiotensin-converting enzyme inhibitors, calcium channel blockers, HMG-CoA reductase inhibitors (statins), beta blockers, and aspirin). Follow-up was 2.19 ± 1.14 years.ResultsThe incidence of ACS was 29/1000 person-years. Factors associated with ACS were older age, the extreme high and low ranges of serum cholesterol level, history of coronary heart disease (CHD), male gender, and diabetes. No cardioprotective medications including statins had a significant association with ACS in this study. However, medications known to reduce mortality after ACS were used in less than 50% of patients with known CHD at the start of the study, and statins were used in less than 10% of patients with CHD.ConclusionsDialysis patients had similar risk factors for ACS compared to the general population. Cardioprotective medications were not associated with a significant benefit, possibly due to their striking underutilization in this at-risk population

Positive symptoms associate with cortical thinning in the superior temporal gyrus via the ENIGMA-Schizophrenia consortium

Objective: Based on the role of the superior temporal gyrus (STG) in auditory processing, language comprehension and self-monitoring, this study aimed to investigate the relationship between STG cortical thickness and positive symptom severity in schizophrenia. Method: This prospective meta-analysis includes data from 1987 individuals with schizophrenia collected at seventeen centres around the world that contribute to the ENIGMA Schizophrenia Working Group. STG thickness measures were extracted from T1-weighted brain scans using FreeSurfer. The study performed a meta-analysis of effect sizes across sites generated by a model predicting left or right STG thickness with a positive symptom severity score (harmonized SAPS or PANSS-positive scores), while controlling for age, sex and site. Secondary models investigated relationships between antipsychotic medication, duration of illness, overall illness severity, handedness and STG thickness. Results: Positive symptom severity was negatively related to STG thickness in both hemispheres (left: βstd = −0.052; P = 0.021; right: βstd = −0.073; P = 0.001) when statistically controlling for age, sex and site. This effect remained stable in models including duration of illness, antipsychotic medication or handedness. Conclusion: Our findings further underline the important role of the STG in hallmark symptoms in schizophrenia. These findings can assist in advancing insight into symptom-relevant pathophysiological mechanisms in schizophrenia